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ABSTRACT 


In  many  computer - implemented  signal-processing  systems,  it  is 
necessary  to  perform  numerical  integrations.  If  the  function  to  be 
integrated  is  a  band-limited  time  signal  represented  by  a  set  of 
samples,  serious  distortion  can  occur  if  the  wrong  integration 
technique  is  used.  In  particular,  if  the  integration  is  used  to 
calculate  a  Fourier  transform,  large  error  sidelobes  will  be 
introduced  if  Simpson's  rule  or  other  higher-order  rules  are  used. 
It  is  shown  that  the  rectangular  rule  introduces  no  distortion  and 
gives  a  result  which  is  consistent  with  the  number  of  samples. 
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SECTION  I 


INTRODUCTION 

The  digital  computer  offers  the  possibility  of  increased  signal 
processor  performance  by  eliminating  the  inaccuracies  inherent  in  an 
analog  operation,  and  by  making  it  relatively  easy  to  implement 
complicated,  flexible  or  physically  unrealizable  techniques. 

Often  a  signal  processor  is  required  to  correlate  two  signals  or 
compute  a  Fourier  transform  of  a  band-limited  signal.  These  two 
operations  are  performed  by  numerical  integrations  of  data  which  are 
quantized  in  amplitude  and  time  (or  frequency) .  It  is  shown  in  this 
paper  that  the  "better"  numerical  integration  techniques  can  give  the 
worst  results  for  band-limited  signals.  Specifically,  the  rectangular 
integration  rule  is  superior  for  these  applications  because  it  does 
not  introduce  distortions  such  as  error  sidelobes  in  the  Fourier 
transform  example. 

The  use  of  the  digital  computer  as  a  signal  processor  is  becoming 
more  popular  in  many  fields  of  endeavor  such  as  seismic  array  analysis 
or  e lectr ocard iogram  interpretation.  Within  the  MITRE  Corporation  there 
are  three  radar  systems  which  have  independently  caused  the  author  to 
consider  the  numerical  integration  problem.  These  include  the  ARPA 
Signal  Processor  (ASP)  System,  the  oblique  HF  Sounder  Experiment  (run 
with  the  cooperation  of  Stanford  Electronics  Labs),  and  the  MITRE  Six 
Inch  Radar  experimental  program. 
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SECTION  II 


NUMERICAL  INTEGRATION 


A  common  linear  operation  that  is  performed  on  sampled  data  is 
the  integral 


(1) 


where  only  samples  of  X(t)  are  known;  i.e., 


x , 
1 


X(t) 


t  =  iT 


for  i  =  0 _ N-l 


and 


Tb  =  JT 

k-j  =  N  =  number  of  intervals 
T  =  sample  spacing 


If  X(t)  is  known  to  be  a  polynomial  of  degree  less  than  N-l  ,  the 
integral  can  be  computed  exactly  because  the  samples  represent  the 

~k 

function  without  approximation.  Usually  this  condition  is  not 

* 

Note:  The  reader  is  referred  to  the  treatment  of  Lagrange  Interpola¬ 

tion  in  Linear  Algebra  by  Hoffman  and  Kuntz . 
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assumed  by  the  integration  rules.  The  function  X(t)  is  often 
assumed  to  be  represented  by  a  polynomial  of  much  smaller  degree 
over  a  small  portion  of  its  argument  (t)  .  For  example,  Simpson’s 

rule  fits  a  second  order  curve  to  every  two  adjacent  intervals  (i.e., 
3  points  define  each  second  order  polynomial).  These  rules  result  in 
the  following  formula  if  the  number  of  intervals  is  even: 


Y  -  X  +  4X1  +  2X9  +  4Xq  .  +  2Xxt  -  +  4X__  0  +  XM  . 

o  1  2  3  N-3  N-2  N-l 


(2) 


where  N  =  odd  integer  =  number  of  samples 


X.  -  X(t) 


t  =  ii 


Using  a  different  order  fit  to  each  set  of  points  results  in  a 
different  integration  rule.  In  general,  the  higher  order  the  fit  and 
the  larger  the  integer  N  ,  the  lower  will  be  the  maximum  error. 

There  are  many  good  texts  on  numerical  analysis  which  cover  this 
broad  subject  in  considerable  detail  and  which  derive  the  accuracy 
bounds  for  each  of  the  rules. 

Time  functions,  however,  have  different  properties  than  poly¬ 
nomial  functions  and  therefore  may  have  different  integration  rules 
as  shown  in  the  following  discussion.  If  X(t)  is  a  time  function, 
band-limited  to  W  cps ,  then  there  is  a  very  simple  interpretation  of 
the  integral.  By  the  sampling  theorem  X(t)  can  be  written 
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X(t)  = 


sin  TTW(t  -  i|  ) 
i  uW(t  -  ir) 


(3) 


l 


where 


T 


_1_ 

2W 


The  X.  are  the  values  of  X(t)  at  t  =  if  . 

1 

Substituting  the  expression  of  X(t)  of  Equation  3  into  the 
integral  in  Equation  1 


Y 


sin  rW (t  -  if ) 

rW(t  -  ii)  L 


(A) 


Y 


8i 


Equation  4  implies  that  in  order  to  integrate  a  band-limited 

signal  over  definite  limits,  the  samples  of  the  signal  must  be  known 

for  all  time.  The  weight  given  each  sample  x_^  is  the  integral  of  a 
sin  x 

portion  of  the  -  function.  If  if  lies  outside  the  interval 


T  -  T  the  weights  become  very  small.  In  fact. 
A  d 


1  im  g  .  =  0 
l 

i-** 
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If  ii  lies  in  the  interval  T  -  T  ,  the  integral  specifying  g. 

Ad  1 

is  approximately  1/  r  because  most  of  the  area  under  the  X 

curve  is  in  the  main-lobe  region. 

As  the  limits  of  integration  become  i^c  the  coefficients  g_^ 

become  equal,  and  have  value  1/  .  This  is  true  because  the  area 

s  in  x 

under  each  of  the  displaced  -  functions  is  independent  of  i 

x 

Therefore  if 


'JO 

Y  =  J  x(t)d  t 

then 

v-i  f  X. 

1  —  1 

In  practice  X(t)  may  be  a  pulsed  band-limited  signal.  Although 
in  theory  it  is  not  possible  for  a  signal  to  be  both  time-limited  and 
bandlimited,  it  is  possible  to  have  most  of  the  energy  in  a  signal 
confined  to  a  t ime -frequency  band.  For  this  type  of  signal,  samples 
of  X(t)  for  i  •  N  will  be  less  than  some  arbitrary  small  value 
and  therefore 

A 

Y  ^  T  )_  X4  (5) 

1  i=l 


5 


In  numerical  analysis,  Equation  5  is  referred  to  as  a  "rec tangu lar " 
integration  rule. 

The  discussion  thus  far  has  included  only  the  integration  of 
band-limited  time  signals.  The  duality  of  time  and  frequency  guarantees 
that  it  would  have  been  equally  valid  to  discuss  the  integral  of  time- 
limited  frequency  functions.  An  example  of  such  an  integration  is 
given  in  the  next  section  on  Fourier  transforms,  and  indicates  the 
type  of  errors  which  can  occur  using  sampling  techniques. 

Equation  5  is  the  major  result  of  this  paper.  It  states  that  the 
best  integration  rule  to  use  for  band-limited  functions  is  an  equally 
weighted  sum  of  the  samples;  namely  the  so-called  rectangular 
integration  rule. 


6 


SECTION  III 


FOURIER  TRANSFORM  TECHNIQUES 

An  application  of  the  previous  discussion  is  the  Fourier  transform 
of  a  frequency  function.  Assume  that  N+l  samples  of  a  "band-limited” 
"time-limited"  frequency  function  are  known.  The  time  signal  is  given 
by  the  following  integration: 

*2 

f(t)  =  J  F (f )  e  j2"ft  df  (6) 

-w 

2 


where  F(f) 


f=kAf 


F,  are  known  . 
k 


Using  the  rectangular  integration  rule  and  applying  the  sampling 
theorem  to  represent  f(t)  the  integral  becomes 


f(t) 


t 


i 

2W 


f . 

l 


N  -1 


Af 

J2r  jg  ik 


(7) 


The  computed  time  function  represented  by  f  is  only  equal  to 
the  desired  time  function  f(t)  for  a  range  of  time  less  than  1 / A f  . 
This  is  true  because  evaluating  F(f)  only  at  intervals  of  f 
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causes  a  periodicity  in  f(t)  with  period  l/\f  as  seen  from  the 
following  argument. 

The  phase  of  the  complex  samples  F  can  only  be  measured 

rv 

t  2t  1 

modulo  2 17  ,  therefore  the  samples  can  be  multiplied  by  e  J 
without  changing  them. 

j2nf£ 

F'k=Fke  (8) 


where  £  is  any  integer . 

The  exponential  term  corresponds  to  a  delay  £/ !\f  ,  which  implies  that 
the  computed  time  signal,  f ( t)  ,  will  be  periodic.  Therefore, 


f(t)  =  f(t  -  IT) 


(9) 


fi  fi+tN 


where  T  =  1/^f 


JL 

Af 


N*H 


Besides  limiting 
f(t)  the  periodicity 
error  into  f.  .  The 

l 


the  values  of  i  for  which  the  f.  represent 

i 

caused  by  sampling  F(f)  also  introduces  an 
following  example  illustrates  this  point.  The 
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transform  of  a  set  of  equal  amplitude  zero  phase  samples,  (i.e., 
=  1  for  jk|  y  is  the  following  periodic  function. 


f  (t) 


sin  Wt 


s  in 


Wt 

N+l 


sin  W(t  - 

/  - 7” 

rW(t  -  -) 


(10) 


If  F  represents  the  samples  of  a  constant  zero  phase  band-limited 

K 

frequency  characteristic,  then  the  desired  transform  f ,  (t)  is  one 

d 

of  the  terms  in  the  last  sum.  Namely,  the  desired  function  is  one 
period  of  f(t) 


fd(t) 


sin  TrWt 
TTWt 


(id 


If  N  is  large  enough  then 


fd(t)  -  f(t) 


r  T  T 

for  -  —  ■  t  <  — 


(12) 


The  error  in  Equation  12  can  be  approximated  by  considering  the 

periodicity  in  f ( t )  .  In  the  simplest  approximation, the  error  in 

Equation  12  is  +  f  ,(t  -  77)  +  f,(t)  f ( t )  .  The  term  f  C t  -  77) 

d  W  d  d  W 

should  be  small  for  t  .  0  ,  therefore 


,  N  x  sin  ,:N 
£dC  W  )  **  tiN 


9 


If  N  is  100  the  error  will  be  -50  db  with  respect  to  the  peak 

of  the  desired  signal.  If  sidelobe  weighting  is  used  the  error  is 

more  difficult  to  determine.  Numerical  calculations  for  specific 

examples  give  an  indication  of  the  magnitude  of  the  errors.  Figures 

1,  2,  3  give  the  time  signal  for  N  =  11,  21  and  101  sample  points 

respectively,  with  40  db  Taylor  weighting  (n  =  6)  .  An  analytic 

bound  for  the  error  is  difficult  to  derive  because  the  Taylor-weighted 

signal  is  difficult  to  characterize  between  t  =  n/W  and  its  asymtotic 
s  in  x 

value  of  — -  .  To  characterize  the  distortion  for  other  types  of 

x  y  r 

signals  one  may  invoke  the  sampling  theorem,  which  states  that  any 

„  sin  TTWt 

band-limited  time  signal  is  composed  of  a  sum  of - - -  functions, 

each  separated  by  1/W  seconds.  To  bound  the  error  in  general  does 
not  seem  possible;  rather  it  is  hoped  that  the  above  discussion  will 
help  the  reader  understand  the  distortion  mechanism. 

The  discussion  of  the  Fourier  transform  has  thus  far  been 
limited  to  the  rectangular-rule  integration  which  was  shown  to  be 
optimum  in  the  earlier  section.  The  Fourier  integral  is  an  easy 
vehicle  for  demonstrating  the  type  of  errors  which  result  when  higher- 
order  integration  rules  are  applied  to  band-limited  signals. 

_ 

Note:  The  reader  must  observe  that  the  bandwidth  for  a  rectangular 

case  is  BW  =  Ncf  while  for  Simpson's  rule  the  bandwidth  is 
BW  =  (N-l)Af  . 
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Figure  I  TRANSFORMED  TAYLOR  WEIGHTING  FUNCTION 
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Figure  2  TRANSFORMED  TAYLOR  WEIGHTING  FUNCTION 
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Figure  3  TRANSFORMED  TAYLOR  WEIGHTING  FUNCTION 


The  following  discussion  is  a  direct  application  of  Fourier 
theory.  Sampling  a  function  [G(F)J  in  the  frequency  domain  is 
equivalent  to  multiplying  it  by  a  set  of  impulses  ^X(f)]  spaced  by 
Af  in  frequency  G(f)‘X(f)]  .  An  infinite  set  of  impulses  in  the 
frequency  domain,  spaced  by  Af  ,  transforms  to  an  infinite  set  of 
impulses  in  the  time  domain,  spaced  by  l/Af  in  time  X(t)j  .  The 
sampled  function  is  represented  in  the  time  domain  as  the  convolution 
of  the  original  time  function  and  the  impulses  spaced  by  l/Af  in 
time  g(t)®X(t)l  .  If  l/Af  is  larger  than  the  duration  in  time 
of  the  signal,  then  a  simple  periodicity  will  be  introduced  into  g(t). 
If  l/Af  is  smaller  than  the  duration  in  time  of  the  signal,  then 
distortion  is  introduced  since  g(t)  repeats  and  overlaps  itself. 

Application  of  this  Fourier  theory  to  sampling  and  numerical 
integration  gives  the  following  general  rule. 

"The  transform  of  a  function  F(f)  is  the  desired 
signal,  f(t)  ,  convolved  with  the  Fourier  trans¬ 
form  of  the  integration  rule." 

The  trapezoidal  rule  indicated  in  Equation  13  merely  weights  the 

first  and  last  sample.  It,  therefore,  will  tend  to  broaden  the  main 
s  in  x 

lobe  of  a  — - —  function  slightly  and  to  reduce  its  sidelobes 
slightly. 


y 


+  x. 


+  X„ 


X 


N-2 


(13) 
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Simpson's  rule,  indicated  in  Equation  2,  weights  every  other 

sample  by  a  factor  of  2.  Thus,  this  rule  has  a  strong  Fourier  component. 

The  transform  of  an  infinite  set  of  equal  samples  (impulses)  is  a 
.  ,  .  sin  x  _  . 

periodic  — ~ —  function.  This  corresponds  to  the  rectangular  rule 

as  shown  in  Figure  4A .  The  transform  of  a  set  of  equal  samples 
alternately  weighted  as  in  Simpson's  rule  has  an  additional  -10  db 
component,  as  shown  in  Figure  4C .  Simpson's  rule  is  approximately  the 
sum  of  two  sets  of  weights,  the  rectangular  weights  of  Figure  4A  and 
the  alternating  plus  and  minus  weights  of  Figure  4B.  The  transform 
of  a  sampled  band-limited  function  which  is  computed  using  Simpson's 
integration  rule  will  be  the  convolution  of  the  desired  transform  with 
the  function  in  Figure  4C .  If  N  is  made  large  enough,  however,  it 
is  possible  to  cause  the  -10  db  error  sidelobe  to  be  far  away  from 
the  main  lobe  and,  therefore,  avoid  significant  errors  in  the  near-in 
region  of  observation. 

The  Fourier  integral  perhaps  is  a  worst-case  example  since  the 
Fourier  components  of  the  rule  are  so  readily  visible.  The  Fourier 
integral  plays  such  an  important  part  in  computer- implemented  signal 
processing  that  these  results  have  a  very  practical  significance.  To 
emphasize  the  type  of  errors  which  can  result,  a  simple  delay-line 
network  is  analyzed.  Figure  5A  shows  three  delay  lines,  each  with  a 
different  gain.  The  impulse  response  of  this  linear  network  is  found 
by  passing  a  sinusoid,  e  J  ,  through  the  network  and  sampling  the 

output.  The  frequency  is  varied  to  give  the  frequency  characteristic, 
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FOURIER  INTERPRETATION  OF  SIMPSON'S  INTEGRATION  RULE 


F(f)  ,  which  is  then  Fourier  transformed.  Figure  5B  gives  the 
resultant  impulse  response  if  a  rectangular  rule  is  used.  Note  that 
N  is  large  enough  to  guarantee  that  aliasing  will  not  occur.  That 
is,  a  portion  of  the  time  function  represents  the  desired  response. 
Simpson's  rule  can  also  be  used  to  compute  the  Fourier  transform  as 
shown  in  Figure  5C .  The  confusion  caused  by  the  error  sidelobes  is 
apparent  from  the  figure. 

These  predictions  were  tested  by  performing  a  transform  on  a 
digital  computer.  Figures  1,  2,  3  give  the  transform  of  a  zero- 
phase,  Taylor  weighted  spectrum  for  N  =  11,  21,  101  samples 
respectively  using  the  rectangular  rule.  Figures  6,  7,  and  8  give 
the  same  transform  using  Simpson's  rule.  In  addition  to  pointing  out 
the  obvious  periodicities  and  the  -10  db  error  sidelobe,  these 
figures  give  an  indication  of  the  increase  in  sidelobes  if  N  is 
made  too  small. 

The  use  of  higher-order  integration  rules  will  also  introduce 
error  sidelobes.  The  magnitude  and  position  of  these  sidelobes  can 
be  found  by  simply  finding  the  Fourier  components  of  the  rule. 

Again  the  observation  is  made  that  N  can  be  made  large  enough 
to  guarantee  good  results  in  the  limited  region  of  interest.  In  a 
signal  processing  system,  however,  where  the  number  of  samples  is 
often  constrained,  the  rectangular  rule  will  require  fewer  samples 
than  higher-order  integration  rules. 
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Figure  6  TRANSFORMED  TAYLOR  WEIGHTING  FUNCTION 


Figure  7  TRANSFORMED  TAYLOR  WEIGHTING  FUNCTION 


Figure  8.  TRANSFORMED  TAYLOR  WEIGHTING  FUNCTION 


SECTION  IV 


SUMMARY 

The  integration  of  band- 1 imited  signals  which  are  accurately 
represented  by  a  set  of  samples  is  a  weighted  sum  of  the  samples.  If 
the  signal  is  a  pulse  so  that  most  of  its  energy  is  confined  in  time 
and  frequency,  the  integral  is  simply  an  unweighted  sum  of  the  samples. 
This  algorithm  corresponds  to  the  rectangular  integration  rule 
described  in  numerical  analysis. 

The  above  results  were  applied  to  the  Fourier  integral.  It  was 
shown  that  Simpson's  rule  and  other  higher-order  rules  would 
introduce  error  sidelobes  if  a  flat  spectrum  was  transformed.  The 
rectangular  rule  does  not  introduce  this  type  of  distortion.  When 
using  the  rectangular  rule,  it  is  necessary  to  consider  the  value  of 
N  and  the  type  of  signal  to  be  transformed.  An  unweighted  flat 
spectrum  may  require  N  =  100  to  achieve  small  errors,  while  a  40  db 
weighted  spectrum  may  require  an  N  as  small  as  25  to  achieve  small 
error . 

In  a  signal-processing  system  the  number  of  samples  N  of  a 
waveform  is  usually  desired  to  be  as  small  as  possible  in  order  to 
minimize  ana  log- to-d igita 1  converter  costs,  computation  time,  etc. 

The  results  of  this  paper  apply  most  readily  to  signal-processor 
problems  where  savings  in  the  number  of  samples  can  be  realized  or 
where  serious  sidelobe  problems  can  be  avoided. 
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\  i  ABSTRACT 


In  many  computer-implemented  signal-processing  systems,  it  is 
necessary  to  perform  numerical  integrations.  If  the  function  to  be  integrated 
is  a  band-limited  time  signal  represented  by  a  set  of  samples,  serious  dis¬ 
tortion  can  occur  if  the  wrong  integration  technique  is  used.  In  particular, 
if  the  integration  is  used  to  calculate  a  Fourier  transform,  large  error  side- 
lobes  will  be  introduced  if  Simpson's  rule  or  other  higher-order  rules  are 
used.  It  is  shown  that  the  rectangular  rule  introduces  no  distortion  and 
gives  a  result  which  is  consistent  with  the  number  of  samples. 
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